SMALL GAIN THEOREMS FOR LARGE SCALE SYSTEMS AND 
CONSTRUCTION OF ISS LYAPUNOV FUNCTIONS* 
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Abstract. We consider interconnections of n nonlinear subsystems in the input-to-state stability 
(ISS) framework. For each subsystem an ISS Lyapunov function is given that treats the other 
subsystems as independent inputs. A gain matrix is used to encode the mutual dependencies of 
the systems in the network. Under a small gain assumption on the monotone operator induced by 
the gain matrix, a locally Lipschitz continuous ISS Lyapunov function is obtained constructively for 
the entire network by appropriately scaling the individual Lyapunov functions for the subsystems. 
The results are obtained in a general formulation of ISS, the cases of summation, maximization and 
separation with respect to external gains are obtained as corollaries. 
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1. Introduction. In many applications large scale systems are obtained through 
the interconnection of a number of smaller components. The stability analysis of such 
interconnected systems may be a difficult task especially in the case of a large number 
of subsystems, arbitrary interconnection topologies, and nonlinear subsystems. 

One of the earliest tools in the stability analysis of feedback interconnections of 
nonlinear systems are small gain theorems. Such results have been obtained by many 
authors starting with [33]. These results are classically built on the notion of gains, 
see [3] for a recent, very readable account of the developments in this area. While 
most small gain results for interconnected systems yield only sufficient conditions, 
in |3] it has been shown in a behavioral framework how the notion of gains can be 
modified so that the small gain condition is also necessary for robust stability. 

Small gain theorems for large scale systems have been developed, e.g., in [25] [MJ 
[23] . In [26^ the notions of connective stability and stabilization are introduced for 
interconnections of linear systems using the concept of vector Lyapunov functions. 
In [53] stability conditions in terms of Lyapunov functions of subsystems have been 
derived. For the linear case characterizations of quadratic stability of large scale inter- 
connections have been obtained in JJJ. A common feature of these references is that 
the gains describing the interconnection are essentially linear. With the introduction 
of the concept of input-to-state stability in |28j . it has become a common approach 
to consider gains as a nonlinear functions of the norm of the input. In this nonlinear 
case small gain results have been derived first for the interconnection of two systems 
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in [iHl . A Lyapunov version of the same result is given in \17^ . A general small 
gain condition for large scale ISS systems has been presented in |^. Recently, such 
arguments have been used in the stability analysis of observers [P, in the stability 
analysis of decentralized model predictive control [22 ^ and in the stability analysis of 
groups of autonomous vehicles. 

During the revision of this paper it came to our attention that, following the first 
general small gain theorems for networks [2TJ 1331 13 [HI 13 IS] , other generalizations 
of small gain results based on similar ideas have been obtained very recently using 
the maximization formulation of ISS: A generalized small gain theorem for output- 
Lagrange-input-to-output stable systems in network interconnections has been ob- 
tained in [19]. In this reference the authors study ISS in the maximization framework 
and conclude ISS from a small gain condition in the cycle formulation. It has been 
noted in [5] that in the maximum case the cycle condition is equivalent to the op- 
erator condition examined here. An extension of generalized small gain results to 
retarded functional differential equations based on the more general cycle condition 
and vector Lyapunov functions has recently been obtained in |20j . In this reference 
a construction of a Lyapunov function is shown which takes a different approach to 
the construction of an overall Lyapunov function. This construction depends vitally 
on the use of the maximum formulation of ISS. 

In this paper we present sufficient conditions for the existence of an ISS Lyapunov 
function for a system obtained as the interconnection of many subsystems. The 
results are of interest in two ways. First, it is shown that a small gain condition 
is sufficient for input-to-state stability of the large scale system in the Lyapunov 
formulation. Secondly, an explicit formula for an overall Lyapunov function is given. 
As the dimensions of the subsystems are essentially lower than the dimension of their 
interconnection, finding Lyapunov functions for them may be an easier task than for 
the whole system. 

Our approach is based on the notion of input-to-state stability (ISS) introduced 
in |28j for nonlinear systems with inputs. A system is ISS if, roughly speaking, it 
is globally asymptotically stable in the absence of inputs (so-called 0-GAS) and if 
any trajectory eventually enters a ball centered at the equilibrium point and with 
radius given by a monotone continuous function, the gain, of the size of the input 
(the so-called asymptotic gain property), cf. |31j . 

The concept of ISS turned out to be particularly well suited to the investigation 
of interconnections. For example, it is known that cascades of ISS systems are again 
ISS [2S] and small gain results have been obtained. We briefly review the results of 
[UlIlT] in order to explain the motivation for the approach of this paper. Both papers 
study a feedback interconnection of two ISS systems as represented in Figure |1.1[ 
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Fig. 1.1. Feedback interconnection of two ISS systems with gains 712 from S2 to Si and 721 
from El to E2 . 



The small gain condition in |18j is that the composition of the gain functions 
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7i2j 721 is less than identity in a robust sense. We denote the composition of functions 
f,g by o, that is, (/ o g){x) :— f(g(x)). The small gain condition then is that if on 
(0, oo) we have 



(id + ai) o o (id + 02) o 721 < id 



(1.1) 



for suitable /Coo functions ai, a2 then the feedback system is ISS with respect to the 
external inputs. 

In this paper we concentrate on the equivalent definition of ISS in terms of ISS 
Lyapunov functions [31j . The small gain theorem for ISS Lyapunov functions from 
jl7j states that if on (0, 00) the small gain condition 



712 o 721 < id 



(1.2) 



is satisfied then an ISS Lyapunov function may be explicitly constructed as follows. 
Condition (1.2 1 is equivalent to 712 < 721^ on (0,oo). This permits t o co nstruct a 



1.2 



An ISS 



function (72 G /Coo such that 721 < (T2 < 7i2^ on (0,cxd), see Figure 
Lyapunov function is then defined by scaling and taking the maximum, that is, by 
setting V{x) = max{Vi(a;i), cr^^(V2(2;2))}- This ISS Lyapunov function describes 
stability properties of the whole interconnection. In particular, given an input it, it 
can be seen how fast the corresponding trajectories converge to the neighborhood and 
how large this neighborhood is. 




Si 



Fig. 1.2. Two gain functions satisfying \1.2\ . 



At first sight the difference between the small gain conditions in (1.1 1 from |18j 
and (1.2 1 from |17j appears surprising. This might lead to the impression that the 
difference comes from studying the problem in a trajectory based or Lyapunov based 
framework. This, however, is not the case; the reason for the difference in the con- 
ditions is a result of the formulation of the ISS condition. In [18j a summation 
formulation was used for the trajectory based case. In the maximization formulation 
of the trajectory case the small gain condition is again ( |1.2[ ), [B]. In [TT] the Lya- 
punov formulation is investigated using maximization, the corresponding result for 
summation is Corollary 5.6 below requiring condition ( |1.1[ ). 

In order to generalize the existing results it is useful to reinterpret the approach 
of [17]: note that the gains may be used to define a matrix 



r := 



712 
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which defines in a natural way a monotone operator on . In this way an alternative 
characterization of the area between 721 and Figure 



1.2 



is that it is the area 

where T(s) < s (with respect to the natural ordering in M'^). Thus the problem of 
finding a2 may be interpreted as the problem of finding a path a : r 1-^ {r,a2{r)),r G 
(0, 00) such that T o a < a. 

We generalize this constructive procedure for a Lyapunov function in several direc- 
tions. First the number of subsystems entering the interconnection will be arbitrary. 
Secondly, the way in which the gains of subsystem i affect subsystem j will be formu- 
lated in a general manner using the concept of monotone aggregation functions. This 
class of functions allows for a unified treatment of summation, maximization or other 
ways of formulating ISS conditions. Following the matrix interpretation this leads to 
a monotone operator on M" . The crucial thing to find is a sufficiently regular path 
a such that F^ o a < cr. This allows for a scaling of the Lyapunov functions for the 
individual subsystems to obtain one for the large scale system. 

Small gain conditions on F^ as in [5l [B] yield sufficient conditions that guarantee 
that the construction of a can be performed. However, in [51|B] the trajectory formu- 
lation of ISS has been studied, and the main technical ingredient was, essentially, to 
prove bounds on (id — F^)^^. The sufficient condition for the existence of the path 
a turns out to be the same, but the path itself had not been used in |5j [6]. In fact, 
the line of argument used there is completely different. It is shown in [Mj that the 
results of [Hj also hold for the more general ISS formulation using monotone aggrega- 
tion functions. The condition requires essentially that the operator is not greater or 
equal to the identity in a robust sense. The construction of a then relies on a rather 
delicate topological argument. What is obvious for the interconnection of two systems 
is not that clear in higher dimensions. It can be seen that the small gain condition 
imposed on the interconnection is actually a sufficient condition that allows for the 
application of the Knaster-Kuratowski-Mazurkiewicz theorem, see [51 123] for further 
details. We show in Section [9] how the construction works for three subsystems, but 
it is fairly clear that this methodology is not something one would like to carry out 
in higher dimensions. In the maximization formulation a viable alternative is the 
approach pursued by ^0] . 

The construction of the Lyapunov function is explicit once the scaling function 
a is known. Thus to have a really constructive procedure a way of constructing a is 
required. We do not study this problem here, but note that based on an algorithm by 
Eaves [TT] it actually possible to turn this mere existence result into a (numerically) 
constructive method [2H [3]. Using the algorithm by Eaves and the technique of 



Proposition 8.8 it is then possible to construct such a vector function (but of finite- 
length) numerically, see [24l Chapter 4]. This will be treated in more detail in future 
work. 

The paper is organized as follows. The next section introduces the necessary nota- 
tion and basic definitions, in particular the notion of monotone aggregation functions 
(MAFs) and different formulations of ISS. Sectionjs] gives some motivating examples 
that also illustrate the definitions of the Section J2]and explain how different MAFs 
occur naturally for different problems. In Sectionfflwe introduce small gain conditions 
given in terms of monotone operators that naturally appear in the definition of ISS. 
Section|5]contains the main results, namely the existence of the vector scaling function 
a and the construction of an ISS Lyapunov function. In this section we concentrate 
on strongly connected networks which are easier to deal with from a technical point of 
view. Once this case has been resolved it is shown in Section [6] how simply connected 
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networks may be treated by studying the strongly connected components. 

The actual construction of ct is given in Section [8] to postpone the topological 
considerations until after applications to interconnected ISS systems have been con- 
sidered in Section [7] Since the topological difficulties can be avoided in the case n = 3 
we treat this case briefly in Section [9]to show a simple construction for a. Section 10 
concludes the paper. 

2. Preliminaries. 

2.1. Notation and conventions. Let M be the field of real numbers and 
the vector space of real column vectors of length n. We denote the set of nonnegative 
real numbers by M+ and M" (M+)" denotes the positive orthant in K". On K" 
the standard partial order is defined as follows. For vectors v,w G M" we denote 

V > w : Vi > Wi for i — I, . . . ,n, 

V > w : -4=^ Vi > Wi for i — 1, . . . ,n, 

V ^ w : V > w and v ^ w. 

The maximum of two vectors or matrices is to be understood component-wise. By 
I • I we denote the 1-norm on K" and by Sr the induced sphere of radius r in K" 
intersected with M" , which is an (n— l)-simplex. On M" we denote by tt/ : M" R]^^ 
the projection of the coordinates in M" corresponding to the indices in / C {1, . . . , n} 
onto R*^. 

The standard scalar product in M" is denoted by (•,•). By Ue{x) we denote the 
open ball of radius e around x with respect to the Euclidean norm 1 1 • 1 1 . The induced 
operator norm, i.e. the spectral norm, of matrices is also denoted by || • ||. 

The space of measurable and essentially bounded functions is denoted by L°° 
with norm || ■ ||oo . To state the stability definitions that we are interested in three 
sets of comparison functions are used: /C = {7 : K+ — > M_|_,7 is continuous, strictly 
increasing, and 7(0) — 0} and /Coo = {7 G /C : 7 is unbounded}. A function /3 : 
M+ X ]R_|_ — > is of class ICC, if it is of class JC in the first argument and strictly 
decreasing to zero in the second argument. We will call a function V : M-). 
proper and positive definite if there are V'2 S ^00 such that 



A function a : is called positive definite if it is continuous and satisfies 

a{r) = if and only if r = 0. 

2.2. Problem Statement. We consider a finite set of interconnected systems 
with state x = [x^, . . . , x^) , where Xi S R^', i = 1, . . . , n and N -.^ J2 ^i- For 
i = 1, . . . ,n the dynamics of the i-th subsystem is given by 

x, = f,{xi,...,Xn,u), X G , W G M*^ /, I M^+*^ ^ M^' . (2.1) 

For each i we assume unique existence of solutions and forward completeness of 
Si in the following sense. If we interpret the variables Xj, j ^ i, and u as unrestricted 
inputs, then this system is assumed to have a unique solution defined on [0, cxi) for 
any given initial condition 2:^(0) G E^' and any L°°-inputs Xj : [0,oo) R^^,j ^ i, 
and u : [0,cx)) ^ M*^. This can be guaranteed for instance by suitable Lipschitz and 
growth conditions on the fi. It will be no restriction to assume that all systems have 
the same (augmented) external input u. 
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We write the interconnection of subsystems (2.1) as 



S: i = /(a;,w), / : M"+*^ ^ M^. (2.2) 
Associated to such a network is a directed graph, with vertices representing the 
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Fig. 2.1. j4n example of a network of interconnected systems and the associated graph. 

subsystems and where the directed edges (?, j) correspond to inputs going from system 



j to system i, see Figure 2.1 We will call the network strongly connected if its 
interconnection graph has the same property. 

For networks of the type that has been just described we wish to construct Lya- 
punov functions as they are introduced now. 

2.3. Stability. An appropriate stability notion to study nonlinear systems with 
inputs is input-to-state stability, introduced in |28j . The standard definition is as 
follows. 

A forward complete system x = f{x,u) with X G M.^,u e M*^ is called input-to- 
state stable if there are /3 S ICC, 7 S /C such that for all initial conditions Xq G M.^ 

and all u e L°^\R+,R^'') we have 



\xit;xo,u{-))\\ </3(||a;o||,i)+7(||w||oo) 



(2.3) 



It is known to be an equivalent requirement to ask for the existence of an ISS Lya- 
punov function, |30j . These functions can be chosen to be smooth. For our purposes, 
however, it will be more convenient to have a broader class of functions available for 
the construction of a Lyapunov function. Thus we will call a function a Lyapunov 
function candidate, if the following assumption is met. 

Assumption 2.1. The function V : M.^ — > IR_|_ is continuous, proper and positive 
definite and locally Lipschitz continuous on M.^ \ {0}. Note that by Rademacher's 
Theorem (e.g., [T2i Theorem 5.8.6, p. 281]) locally Lipschitz continuous functions on 

\ {0} are differentiable almost everywhere in K^. 

Definition 2.2. We will call a function satisfying Assumption 2.1 an ISS Lya- 
punov function for X = f{x,u), if there exist 7 € /C, and a positive definite function 
a such that in all points of differential) ility of V we have 



V{x)>^{\\u\\) 



VV{x)f{x,u) < -ai\\x\\). 



(2.4) 



ISS and ISS Lyapunov functions are related in the expected manner: 
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Theorem 2.3. A system is ISS if and only if it admits an ISS Lyapunov function 
in the sense of Definition \2.^ 

This has been proved for smooth ISS Lyapunov functions in the Hterature |30] . 
So the hard converse statement is clear, as it is even possible to find smooth ISS Lya- 
punov functions, which satisfy Definition |2.2[ The sufficiency proof for the Lipschitz 
continuous case goes along the lines presented in 121] using the necessary tools 
from nonsmooth analysis, cf. [4, Theorem. 6.3]. 

Merely continuous ISS Lyapunov functions have been studied in [14, Ch. 3], arising 
as viscosity supersolutions to certain partial differential inequalities. Here we work 
with the Clarke generalized gradient dV{x) of V at x. For functions V satisfying 
Assumption |2. 1| Clarke's generalized gradient satisfies for a: 7^ that 



dV{x) ^ conv{C e M" : 3xk x : "^Vixk) exists and VV{xk) C} ■ (2-5) 



An equivalent formulation to (2.4 1 is given by 



Vix)>j{\\u\\) =^ yC(^dV{x): {C,f{x,u)) <~ai\\x\\). (2.6) 



Note that (2.6 1 is also applicable in points where V is not differentiate. 



The gain 7 in (2.3 1 is in general different from the ISS Lyapunov gain in (2.4 1 



In the sequel we will always assume that gains are of class /Coo • 

2.4. Monotone aggregation. In this paper we concentrate on the construc- 
tion of ISS Lyapunov functions for the interconnected system E. For a single subsys- 



tem (2.1 1, in a similar manner to (2.4 1, we wish to quantify the combined effect of the 
inputs Xj, j 7^ i, and u on the evolution of the state Xi. As we will see in the examples 
given in Section [3] it depends on the system under consideration how this combined 
effect can be expressed, through the sum of individual effects, using the maximum of 
individual effects or by other means. In order to be able to give a general treatment 
of this we introduce the notion of monotone aggregation functions (MAFs). 

Definition 2.4. A continuous function fi : M" — > is called a monotone 
aggregation function if the following three properties hold 

(Ml) positivity: ^J.{s)> for all s G M" and ^(s) > if s>0; 

(M2) strict increas^ if x <y, then ii{x) < ii{y); 

(MS) unboundedness: if \\x\\ — > 00 then fi{x) — s- 00. 
The space of monotone aggregation functions is denoted by MAF„ and fi G MAF™ 
denotes a vector MAF, i.e., fii € MAF„, for i — 1, . . . ,m. 

A direct consequence of (M2) and continuity is the weaker monotonicity property 

(M2') monotonicity: x < y => ^j,{x) < ^{y). 
In [211 US] MAFs have additionally been required to satisfy another property, 

(M^) subadditivity: -t- y) < ^J'{x) + fJ.{y), 
which we do not need for the constructions provided in this paper, since we take a 
different approach, see Section |6] 

Standard examples of monotone aggregation functions satisfying (Ml) — (M4) are 

n 

fi{s) — s\, where ^ > 1, or fi{s) — max Si or 

i=l 

^(■31,52, 33,34) = max{si, S2} -I- max{s3, S4} - 



^Cf. Assumption ||2.10[l, where for the purposes of this paper (M2) is further restricted. 
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On the other hand, the following function is not a MAF, since (Ml) and (M3) are not 
satisfied; v{s) = YYi=i ^i- 

Using this definition we can define a notion of ISS Lyapunov function for systems 



with multiple inputs. In this case in (2.1 1 will have several gains jij corresponding 
to the inputs Xj . For notational simplicity, we will include the gain "fa = throughout 
this paper. The following definition requires only Lipschitz continuity of the Lyapunov 
function. 

Definition 2.5. Consider the interconnected system (2.2 1 and assume tha t for 



satisfying Assumption 



2.1 



each subsystem Sj there is a given function Vj 

For i — 1, . . . ,n the function Vi : M^' — > M+ is called an ISS Lyapunov function 
forYii, if there exist fii G MAF„+i,7ij e /CooU{0},j ^ i,7m G /CU{0}, and a positive 
definite function Ui such that at all points of differentiability of Vi 



Vi{xi) > fii (7ii(Vi(a;i)), . . . , 7i„(F„(x„)), 7i„(||u||)) 
=^ VVi{xi)fi{x,u) < -a^{\\xi\\) . 



(2.7) 



The functions jij and jiu are called ISS Lyapunov gains. 

Several examples of ISS Lyapunov functions are given in the next section. 

Let us call Xj, j ^ i, the internal inputs to and u the external input. Note 
that the role of functions 7^- and jiu is essentially to indicate whether there is any 
influence of different inputs on the corresponding state. In case fi does not depend 
on Xj there is no influence of Xj on the state of S^. In this case we define jij = 0, in 
particular always 7^ =0. This allows us to collect the internal gains into a matrix 



r :— i'yij)i,j = l,...,n ■ 



(2.8) 



If we add the external gains as the last column into this matrix then we denote it by 
r. The function /i^ describes how the internal and external gains interactively enter 
in a common influence on Xi . The above definition motivates the introduction of the 
following nonlinear map 



Si 



Aii(7ii(si), • • ■ , 7in(s„), 7i«('')) 



Ain(7nl(si), . . . 



(2.9) 



Similarly we define Tfj_(s) :— Tf^(s, 0). The matrices F and F are from now on referred 
to as gain matrices, F^ and F^ as gain operators. 

Remark 2.6 (general assumption). Given F G (/Coo U {0})"''" and ^ G MAF", 
we will from now on assume that F and 11 are compatible in the following sense: For 
each z = 1, . . . , n, let li denote the set of indices corresponding to the nonzero entries 
in the ith row ofT. Then it is understood that also the restriction of jii to the indices 
li satisfies (M2), i.e., 



i^iiAh) < f^iivlh) < y\u 



(2.10) 



In particular we assume that the function 

s i-> ^(si,...,s„,0), sGM", 
for fj, G MAF„+i satisfies (M2). Note that (Ml) and (MS) are automatically satisfied. 
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The examples in the next section show exphcitly how the introduced functions, 
matrices and operators may look like for some particular cases. Clearly, the gain 
operators will have to satisfy certain conditions if we want to be able to deduce 
that (2.2) is ISS with respect to external inputs, see Section |5] 



3. Examples for monotone aggregation. In this section we show how dif- 
ferent MAFs may appear in different applications, for further examples see jlO]. We 
begin with a purely academic example and discuss linear systems and neural networks 
later in this section. Consider the system 

x = -x-2x^+^{l + 2x'^)u'^ + ^w (3.1) 

where x,u,w G M. Take V{x) = Lyapunov function candidate. It is easy to 

see that if \x\ > v? and > \w\ then 

V <-x^ - 2x^ + ^a;2(l + 2x^) + \<sp- = -x'' < 

if a; ^ 0. The conditions |a;| > and |a;| > \w\ translate into |a;| > max{u^, \wW and 
in terms of V this becomes 

V{x) > max{u''/2, u;V2} =^ V{x) < -x^ . 

This is a Lyapunov ISS estimate where the gains are aggregated using a maximum, i.e., 
in this case we can take /x(si, S2) = max{si, S2] and 7u(r) = r^/2 and 7to(?') = r^/2. 

Note that there is a certain arbitrariness in the choice of and . In the example 
one could as well take ^u{r) = Jwir) = r and /x(si,S2) = max{s|/2, S2/2}, giving 
exactly the same condition, but different gains and a different monotone aggregation 
function. At the end of the day the small gain condition comes down to mapping 
properties of T^. Different choices of T and fj, may lead to the same operator T^. 
However, as we will see at a later stage, certain choices of fi can be computationally 
more convenient than others. In particular, if we can choose /i — max, the task of 
checking the small gain condition reduces to checking a cycle condition, cf. Section [8. 4[ 

3.1. Linear systems. Consider linear interconnected systems 

n 

I^i : x^ = AiXi + ^AijXj + BiU^, i=l,...,n, (3.2) 

with Xi E M.^',Ui £ M*^', and matrices Ai,Bi,Aij of appropriate dimensions. Each 
system is ISS from {xf , . . . ,xf_i,xf_^_i, . . . ,x'^,uf)'^ to Xi if and only if is 
Hurwitz. It is known that Ai is Hurwitz if and only if for any given symmetric positive 
definite there is a unique symmetric positive definite solution Pi of AfPi + PiAi = 
—Qi, see, e.g., [T51 Cor. 3.3.47 and Rem. 3.3.48, p.284f]. Thus we choose the Lyapunov 
function Vi{xi) = xfPiXi, where Pi is the solution corresponding to a symmetric 
positive definite Qi. In this case, along trajectories of the autonomous system 

Xi — AiXi 

we have 



Vi — Xi PiAiXi + Xj^ A^ PiXi — 



Xi QiXi ^ C2||a^j|| 
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for a :— XminiQi) > 0, the smallest eigenvalue of Qi. For system (3.2) we obtain 



< -c^\\x,f + 2||a;,||||P,||(^ ||A,,||||a:,| 



-Billllwill < -ecAlx. 



II "^Z II ; 



where the last inequality (3.3 1 is satisfied for a given < e < 1 if 

2||P, 



x, > 



C,;(l - e) 



Aij II ||xj I 



IB.IIIImI 



(3.3) 



(3.4) 



with u := {w[ , . . . jU^y . To write this implication in the form (2.7 1 we note that 
Amin(-P»)||a;i|p < Vi{xi) < Xml,^{P^)\\x^\\^ . Let us denote af = A,nin(-P»), &f = 
Amax(^i) = II II I then the inequality (3.4 1 is satisfied if 

2 



\m-\\x.^\'>mx.)>\\p£ 



Cj(l - e) 



115.1111^.11 



This way we see that the function Vi is an ISS Lyapunov function for with gains 
given by 

26? I|A„ 



Cj(l - e) aj 



for i — I, . . . ,n, i ^ j , and 



c,(l - e) ' 



for i = 1, . . . , n, and s > 0. Further we have 



for s e K!;: and r e M+. This fii satisfies (Ml), (M2), and (M3), but not (M4). By 
defining "fa = for i — 1, . . . , n we can write 

/ 712 • • • 7ln 7lM \ 

72n 72u 



r = 



721 

V 7«i 



and have 



7n,n-l 7„.u / 

[{^y{E,^j^v^+\\Bn\\ry) 



(3.5) 



Interestingly, the choice of quadratic Lyapunov functions for the subsystems naturally 
leads to a nonlinear mapping F^ with a useful homogeneity property, see Proposi- 
tion [Til 
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3.2. Neural networks. As the next example consider a Cohen-Grossberg neural 
network as in [35 . The dynamics of each neuron is given by 



NN,; 



Xi{t) = -a,{xi{t))(bi{xi{t)) - '^tijSj{xj{t)) + Jj^, (3.6) 



i = 1, . . . ,n, n > 2, where Xi denotes the state of the i-th neuron and a.; is a strictly 
positive amplification function. As in |35j we assume that the fixed point is shifted 
to the origin. Then the function 6^ typically satisfies the sign condition bi{xi)xi > 
and satisfies furthermore |fei(a;i)| > 6i(|a:;i|) for some bi e /Coo- The activation function 
Si is typically assumed to be sigmoid. The matrix T = (tij)ij=i,...,n describes the 
interconnection of neurons in the network and Jj is a given constant input from 
outside. However for our consideration we allow Ji to be an arbitrary measurable 
function in Lao- 

In applications the matrix T is usually the result of training using some learning 
algorithm and appropriate training data. The specifics depend on the type of network 
architecture and learning algorithm chosen and on the particular application. Such 
considerations are beyond the scope of the current paper. We simply assume that T 
is given and concern ourselves solely with stability considerations. 

Note that for any sigmoid function Sj there exists a 7^ e /C such that |si(a;j)| < 
7i(|a;i|). Following f3F we assume < a ^ < ai{xi) < ai, ai,ai £ M. 

Recall the triangle inequality for /Coo-functions: For any 7,p e /Coo and any 
a, 6 > it holds 

7(a + 6) < 70 (id + p)(a) + 70 (id + p"i)(&). 



We claim that Vi{xi) :— \xi\ is an ISS Lyapunov function for NN^ in (3.6). Fix 
an arbitrary function p G /Coo and some e satisfying a, > £ > 0. Then by the triangle 
inequality we have 

|x.|>6r'°(id + p) [^ENl7,(k,l)j +6r'°(id + p-') (^i-^^i) 

n ^ 

I]|iul7j(k,l) + |J^| 



n 

=> Vi = -at{xi)(^\bi{xi)\ - sign Xt^^tijSj{x j) + signxiJ,;^ < -e\bi{x.i)\ . 

In this case we have 

/i,(s, r) = o (id + p)(si + • • • + s„) + o (id + p-^){r) 
additive with respect to the external input and 

ai\tij\ Uiid 

7»j = 7j ( I ) , 7m = ■ 

a, — £ a,- — e 



The MAF ^ satisfies (Ml), (M2), and (M3). It satisfies (M4) if and only if (b,)''^ is 
subadditive. 
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4. Monotone Operators and generalized small gain conditions. In Sec- 



tion 2.4 we saw that in the ISS context the mutual influence between subsystems (2.1 1 
and the influence from external inputs to the subsystems can be quantified by the gain 
matrices T and T and gain operators and T^. The interconnection structure of the 
subsystems naturally leads to a weighted, directed graph, where the weights are the 
nonlinear gain functions, and the vertices are the subsystems. There is an edge from 
the vertex i to the vertex j if and only if there is an influence of the state Xi on the 
state Xj, i.e., there is a nonzero gain jji. 

Connectedness properties of the interconnection graph together with mapping 
properties of the gain operators will yield a generalized small gain condition. In 
essence we need a nonlinear version of a Perron vector for the construction of a 
Lyapunov function for the interconnected system. This will be made rigorous in the 
sequel. But first we introduce some further notation. 

The adjacency matrix Ar = (aij) of a matrix T e (/Coo U {O})"'^" is defined by 
aij = if 7ij = and = 1 otherwise. Then = {a-ij) is also the adjacency matrix 
of the graph representing an interconnection. 

We say that a matrix T is primitive, irreducible or reducible if and only if Ay is 
primitive, irreducible or reducible, respectively. Recall (and see P] for more on this 
subject) that a nonnegative matrix A is 

• primitive if there exists a fc > 1 such that A^ is positive; 

• irreducible if for every pair (i,j) there exists a, k > \ such that the (i,j)th 
entry of A^ is positive; obviously, primitivity implies irreducibility; 

• reducible if it is not irreducible. 

A network or a graph is strongly connected if and only if the associated adjacency 
matrix is irreducible, see also |2j. 

For /Coo functions ai, . . . , a„ we define a diagonal operator D : W] M" by 



D{s) := (si + ai{si),. . . , s„ + a„(s„))^ 



s e 



(4.1) 



For an operator T : M" — > K", the condition T ^ id means that for all s 7^ 0, 
T(s) ^ s. In words, at least one component of T{s) has to be strictly less than the 
corresponding component of s. 

Definition 4.1 (Small gain conditions). Let a gain matrix T and a monotone 
aggregation fj, be given. The operator is said to satisfy the small gain condi- 



tion (SGCl, if 



Tu ^ id, 



(SGC) 



Furthe 



as in (4.1 1 such that 



e, satisfies the strong small gain condition (sSGCl, if there exists a D 



D oTfj^ ^ id. 



(sSGC) 



It is not diflicult to see that ( sSGC I can equivalently be stated as 



T^oD^ id. 



(sSGC) 



Also for (sSGCl or (sSGC) to hold it is sufficient to assume that the function 
ai, . . . , a„ are all identical. This can be seen by defining a(s) :— imiii ai{s). We 
abbreviate this in writing D = diag(id + a) for some a e /Coo- 
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For maps T : M!f: M" we define the following sets: 

n 

n{T) := {s e Rl : T{s) < s} = f] n,{T), where 

1=1 

If no confusion arises we will omit the reference to T. Topological properties of the 



introduced sets are related to the small gain conditions ( SGC ) , cf . also [5J EJ • They 
will be used in the next section for the construction of an ISS Lyapunov function for 
the interconnection. 

5. Lyapunov functions. In this section we present the two main results of the 
paper. The first is a topological result on the existence of a jointly unbounded path 
in the set fi, provided that satisfies the small gain condition. This path will be 
crucial in the construction of a Lyapunov function, which is the second main result 
of this section. 

Definition 5.1. A continuous path a e ICJ^ will be called an fi-path with respect 

to if 

(i) for each i, the function is locally Lipschitz continuous on (0,cxd); 
(ii) for every compact set K C (0,cx)) there are constants < c < C such that 
for all i — 1, . . . , n and all points of differentiability of we have 

< c < (f7ri)'(r) <C, WeK; (5.1) 

(Hi) a{r) e f^(r^) for all r > 0, i.e. 

T ^{n{r)) < a{r) , Vr > . (5.2) 

Now we can state the first of our two main results, which regards the existence 
of fi-paths. 

Theorem 5.2. LetV e (/CooU{0})"^" be a gain matrix and £ MAF^. Assume 
that one of the following assumptions is satisfied 

(i) is linear and the spectral radius ofTf^ is less than one; 
(ii) r is irreducible and ^ id; 
(Hi) n = max and ^ id; 

(iv) alternatively assume that F^ is bounded, i.e., F e ((/C \ /Coo) U {0})"^", and 
satisfies F^ ^ id. 
Then there exists an fl-path a with respect to F^. 

We will postpone the proof of this rather topological result to Section [8] and 



reap the fruits of Theorem 5.2 first. Note, however, that for (iii) there exists a 



"cycle gain < id" -type equivalent formulation, cf. Theorem 8.14 and see ^Tl [551 [SI EU] . 

In addition to the above result, the existence of fi-paths can also be asserted 
for reducible F and F with mixed, bounded and unbounded, class K. entries, see 
Theorem |8.12| and Proposition |8.13[ respectively. 



Theorem 5.3. Consider the interconnected system S given by (2.11, (2.2| where 
each of the subsystems has an ISS Lyapunov function Vi, the corresponding gain 
matrix is given by (2.8 I, and ^ — (/ii, . . . ,/i„)"^ is given by (2.7l. Assume there are 



an ri-path a with respect to F^ and a function ip £ K.^ 

r^(fT(r),(^(r)) <a(r), Vr>0 (5.3) 
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is satisfied, then an ISS Lyapunov function for the overall system is given by 

V{x)= max a^\V,{x,)). (5.4) 

2— 1, ...,n 

In particular, for all points of differentiability of V we have the implication 

V{x)>msix{ip-\-f,^{\\u\\))\i=l,...n} =^ VF(x)/(x, m) < -a(||x||) , (5.5) 

where a is a suitable positive definite function. 

Note that by construction the Lyapunov function V is not smooth, even if the 
functions Vi for the subsystems are. This is why it is appropriate in this framework 
to consider Lipschitz continuous Lyapunov functions, which are differentiable almost 
everywhere. 

Proof. We will show the assertion in the Clarke gradient sense. For a; = there 
is nothing to show. So let ^ a; = {xj , . . . , x'^)^ . Denote by / the set of indices i for 
which 

V{x) = ar\V.{x,)) > m^xa-\Vj{x,)) . (5.6) 

Then Xi ^ 0, for i G /. Also as V is obtained through maximization we have because 
of m p.83] that 



dV{x) c conv i IJ (9[crri ^y^^ ^^j^^-j 



(5.7) 



Fix i Cz I and assume without loss of generality i = 1. Then if we assume 
V{x) > max.i^i^..._„{iy9~^(7i„(||M||))} it follows in particular that 7iti(|jM||) < (p{V{x)). 
Using the abbreviation r := V{x), denoting the first component of F^ by F^^i and 
using assumption (|5.3|) we have 



l^i(a;i) = (7i(r) >F^,i(a(r),^(r)) 

= Ml [7ii(cri (»■)), • ■ ■,Jin{crn{r)), (p{r)] 

> Ml [lii{<^i{r)), ■ ■ . ,7in(c^n(?-)),7i„(||u||)] 

= Ml [711 o en o erf ^(Vi (2^1)), . . . ,7i„ o a-„ o erf ^(Vi(a;i)), 7i„(||m||)] 

> Ml [711 ° yi{xi), . . . ,7i„ o l/„(a;„),7i„(||u||)] , 



where we have used (5.6) and (M2') in the last inequality. Thus the ISS condition 



(2.7) is applicable and we have for all Q G dVi{xi) that 

(C,/i(a;,«))<-«i(||xi||) . (5.8) 
By the chain rule for Lipschitz continuous functions [H Theorem 2.5] we have 

9(a-i o Vi){xi) C {cC : c e dar\y) , y = V,{xi) , C G dV,{x,)} . 
Note that in the previous equation the number c is bounded away from zero because 



of (|5A|. We set for p > 

ai{p) := Cp^ittiip) > 0, 



ISS LYAPUNOV FUNCTIONS FOR INTERCONNECTED SYSTEMS 



15 



where Cp ^ is the constant corresponding to the set K {xi G M * : p/2 < 



W^iW ^ 2/9} given by (5.11 in the definition of an il-path. With the convention x = 
{xj , . . . , x^)"^ we now define for r > 

a(r) =min{5,(||a;,||) | \\x\\ = r,V{x) = c7-^{V,{x,)))} > 0. 

Here we have used that for a given r > and ||x|| = r the norm of \\xi\\ such that 
V{x) — a~^{Vi{xi))) is bounded away from 0. 



It now follows from (5.8) that if V{x) > max^^i^ „{(y3 "'^(7iii(||u||))}, then we 
have for all C G 9 [af ^ o ViJ (xi) that 

{CJi{x,u)) <-a{\\x\\) . (5.9) 

In particular, the right hand side depends on x and not only onxi. The same argument 



applies for all i e /. Now for any C G dV{x) we have by (5.7) that C = Sie/ KciQ 
for suitable \i > 0, J2iei '^i ~ ^ ^^^^ ^ ^(^» ° ^^^1 q € 9(Tj^^(Fi(a;i)). It 

follows that 



iei 

<-5]A,a(||x||) = -a(|ix|i). 



This shows the assertion. □ 

In the absence of external inputs, ISS is the same as 0-GAS (cf. [251 1301 131] ) • We 
note the following consequence in the case that only global asymptotic stability is of 
interest. 

Corollary 5.4 (0-GAS for strongly interconnected networks). In the setting of 
Theorem \5.3\ assume that the external inputs satisfy u = and that the network of 
interconnected systems is strongly connected. IfT^^ ^ id then the network is 0-GAS. 

Proof. By Theorem|5.2|(ii) there exists an fi-path and a nonsmooth Lyapunov for 



the network is given by (5.4), hence the origin of the externally unforced composite 
system is GAS. □ 

Remark 5.5. At first sight it might seem that the previous corollary is stronger 
than tT8[ Cor. 2.1], as no robustness term D is needed in the assumptions. However, 
the result here is formulated for Lyapunov functions whereas the result in ^181 is based 
on the trajectory formulation of ISS in summation form. The proof in the trajectory 
version essentially requires bounds on (id— r^)~^, which relies heavily on D unless 
fjL = max, \1<A YM^ - I'^ contrast, for 0-GAS the D is not needed in the Lyapunov 
setting, because for irreducible T it is possible to construct the path a without D by 



Theorem 5.2 (ii) 



We now specialize the Theorem 5.3 to particular cases of interest. Namely, when 
the gain with respect to the external input u enters the ISS condition (i) additively, 
(ii) via maximization and (iii) as a factor. 

Corollary 5.6 (Additive gain of external input u). Consider the interconnected 



system S given by (2.1), (^2.2| where each of the subsystems Sj has an ISS Lyapunov 



function Vi and the corresponding gain matrix is given by (2.9). Assume that the ISS 
condition is additive in the gain of u, that is, 

T^iViixi), . . . , y„(a:„), ||u||) - T^{Vi{xi), . . . , Vn{Xn)) + lui\\u\\) , (5.10) 
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where 7ti(||it||) = (7iu(||m||), . . . , 7„t,(|ju||))'^. IfT^ is irreducible and if there exists an 
a e /Coo such that for D — diag(id+a) the gain operator T^^ satisfies the strong small 
gain condition 

DoTf,{s) ^ s 



then the interconnected system is ISS and an ISS Lyapunov function is given by (5.4 1, 
where a € JC^ is an arbitrary fl-path with respect to I? o F^. 

Proof. By Theorem 5.2 an il{D oT f^)-pa,th a exists. Observe that by irreducibihty, 
(Ml), and (M3) it follows that r^(o') is unbounded in all components. Let 93 € /Coo 
be such that for all r > 



{a(r^,,(cr(r)))} > max {7*«('/'W)} 



2— l,...,n 



Note that this is possible, because on the left we take the minimum of a finite number 
of /Coo functions. Then we have for all r > 0, i = 1, . . . , n that 



5.3 



□ 



Thus (T(r) > T fj_(cr(r), (p{r)) and the assertion follows from Theorem 

Corollary 5.7 (Maximization w.r.t. external gain). Consider the intercon- 
nected system S given by ( |2.1| , ( |2.2[ ) where each of the subsystems has an ISS 
Lyapunov function Vi and the corresponding gain matrix is given by (2.9 I. Assume 
that u enters the ISS condition via maximization, that is, 



V^{Vi{xi), . . . , K(a;„), \\u\\) - max{r,,(Fi(a;i), . . . , K(a;„)), 7«(hll)} , (5.11) 

it||))"^. Then, if T ^ is irreducible and satisfies 



w/iere 7„(||u||) = (7i„(||u||), . . . , 7„„ 
the small gain condition 



the interconnected system is ISS and an ISS Lyapunov function is given by (5.4 1, 
where a S /C^ is an arbitrary fl-path with respect to and ip is a /Coo function with 
the property 



liu ° v{r) < r^,i(cr(r)) , i = 1, 



(5.12) 



where ^ denotes the i-th row ofT^. 

Proof. By Theorem 5.2 an ri(F^)-path a exists. Note that by irreducibility, 
(Ml), and (M3) it follows that rp((T) is unbounded in all components. Hence ip G /Coo 
satisfying ( |5.12 1 exists and we obtain 

cr(r) > max{ T f,{cr{r)),ju{f{r))} ■ 



This is (5.3 1 for the case of maximization of gains in u. The claim follows from 
Theorem 15.31 □ 

In the next result observe that (M3) is not always necessary for the u-component 

of fl. 

Corollary 5.8 (Separation in gains). Consider the interconnected system E 
given by (2.1 1, (2.2 I where each of the subsystems has an ISS Lyapunov function 
Vi and the corresponding gain matrix T is given by (2.9 I. Assume thatT is irreducible 
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and that the gains in the ISS condition are separated, that is, there exist jj, € MAFj^, 
c € M, c > 0, and 7„ e /Cqo such that 



T^{Vi{xi),...,Vn{xn),\\u\\) = (c + 7„(||u||)) (xi) , . . . , F„ (x„)) , 



(5.13) 



// there exists an a G /Coo such that for D = diag(c ■ id + id ■ a) the gain operator 
satisfies the strong small gain condition 

D o r^(s) ^ s 

then the interconnected system is ISS and an ISS Lyapunov function is given by ( |5.4| , 
where a G /C^ is an arbitrary fl-path with respect to D o T^{s). 

Proof. If is irreducible, then also DoF^ is irreducible and so by Theorem 5.2 (ii) 
an ^1{D o rp)-path a exists. Let (p G /Coo be such that for all r > 

if{r)< mm {7;;^ o a o r^^i(cr(r))} , 

^— l,...,n 

where as in the previous corollaries we appeal to irreducibility, (Ml), and (M3). Then 
for each i we have 



a,{r) > T^4a{r)){c + a(r^,,(a(r)))) > r^,.(a(r))(c + 7„ o ^{r)) 



and hence 



air) > (c + 7„(^(r)))r^(a(r)) = r^(a(r), ^(r)) 



and the assertion follows from (5.13) and Theorem 5.3 □ 

6. The reducible case and scaling. The results that have been obtained so 
far concern mostly strongly connected networks, that is, networks with an irreducible 
gain operator. Already in ^27] it has been shown that cascades of ISS systems are ISS. 
Cascades are a special case of networks where the gain matrix is reducible. In this 
section we briefly explain how a Lyapunov function for a network that is not strongly 
connected may be constructed based on the construction for the strongly connected 
components of the network. Another approach would be to construct the fi-path for 
reducible operators as has been done in [25] using assumption (M4). 

It is well known, that if the network is not strongly connected, or equivalently if 
the gain matrix F is reducible, then F may be brought in upper block triangular form 
via a permutation of the vertices of the network as in the nonnegative matrix case 
[2J |B] . After this transformation F is of the form 



Tu 




T12 
T22 



- dd 



- du 



(6.1) 



where each of the blocks on the diagonal Tjj e (/Coo U {0}) ^ j — 1, . . . is 
either irreducible or 0. Let qj — X^ti with the convention that qi = 0. We denote 
the states corresponding to the strongly connected components by 



9i + iJ 
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We will show that in order to obtain an overall ISS Lyapunov function it is sufficient 
to construct ISS Lyapunov functions for each of the irreducible blocks (where the 
respective states with higher indices are treated as inputs). The desired result is an 
iterative application of the following observation. 
Lemma 6.1. Let a gain matrix T e (/Cq 



U {0})^^^ be given by 



7i2 7i« 
72u 



(6.2) 



ch 



and let be defined by fi G MAF3. Then there exist an il-path a and G /C, 
that (5.3 1 holds. 

By construction the maps 771 : r i— > /ii(7i2(''), 7iti('")) and 772 : r i-^- 
Choose a /Coo-function 7^1 > rji, such that fji satisfies the 

[2ryi(r) 



Proof. 
/^2(7i2(u)) are in /C, 

conditions (i) and (ii) in Definition 5.1 Define <7{r) = [2ryi(r) r^ and ip{r) 
min{r, 77^^(r/2)}. Then it is a straightforward calculation to check that the assertion 
holds. □ 

The result is now as follows. 

Proposition 6.2. Consider a simply connected interconnected system E given 



by (2.11, (2.2) where each of the subsystems Ej has an ISS Lyapunov function Vi, the 
corresponding gain matrix is given by (2.8l, and /i = (/ii, . . . ,/iri)"^ is given by (2.7l. 
Assume that the gain matrix T is in the reduced form ( |6.1| . If for each j = 1, . . . , d—1 
there exists an ISS Lyapunov function Wj for the state Zj with respect to the inputs 
Zj+i, . . . , Zd, M then there exists an ISS Lyapunov function V for the state x with 
respect to the input u. 

Proof. By assumption for each j — 1, . . . , d— 1 there exist gain functions Xjk G A^oo 
and Xju G ^00 and MAFs jlj such that 

Wj{zj) > jl^{xjj+i{Wj+i{zj+i)), . . . ,Xjd{Wd{zd)),Xju{\\u\\)) 

=> VWj{zj)fj{zj,Zj+i, ...,Zd,u)< -&j{\\zj\\) . 

We now argue by induction. If d = 1, there is nothing to show. If the result is shown 



for d~ 1 blocks, consider a gain matrix as in (6.1 ). By assumption there exists an ISS 
Lyapunov function Vd-i such that 



Vd~i{zd^i) > Mi(7i2(Vd(zd)),7iu(l|u||)) 

=^ '^Vd-i{zd-i)fd-i{zd- 



.Zd,u) < -ad-ii\\zd-i\\) ■ 



As the remaining part has only external inputs, we see that F is of the form (6.2) and 



so Lemma|6.1|is applicable. This shows that the assumptions of Theorem pT3l are met 



and so a Lyapunov function for the overall system is given by (5.4). □ 

It is easy to see that the assumption F^ ^ id (or F^ o £) ^ id) is equivalent to 
the requirement that the blocks Tjj on the diagonal satisfy the (strong) small gain 



condition (SGCl/(sSGCl. Thus we immediately obtain the following statements. 

Corollary 6.3 (Summation of gains). Consider the interconnected system E 
given by (2.1), (2.2) where each of the subsystems E^ has an ISS Lyapunov function 



Vi and the corresponding gain matrix is given by (2.9). Assume that the ISS condition 
is additive in the gains, that is, 



7*j(V'j(a;j)) + 7»„(||w||) . 



(6.3) 
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If there exists an a G /Coo such that for D — dia,g{id+a) the gain operator T^^ satisfies 
the strong small gain condition 

D o r^(s) ^ s 

then the interconnected system is ISS. 

Proof. After permutation T is of the form (6.1 1. For each of the diagonal blocks 
Corollary |5.6| is applicable and the result follows from Proposition |6.2[ □ 

Corollary 6.4 (Maximization of gains). Consider the interconnected system E 
given by (2.11, (2.2 1 where each of the subsystems has an ISS Lyapunov function 
Vi and the corresponding gain matrix is given by (2.9 1. Assume that the gains enter 



the ISS condition via maximization, that is, 

r^,i(V'i(a;i), . . .,Vn{xn), \\u\\) = max{7ii(Vi(a;i)), . . . ,^in{Vn{xn)),liu{\\u\\)} ■ (6.4) 
// the gain operator T ^ satisfies the small gain condition 

then the interconnected system is ISS. 

Proof. After permutation V is of the form (6.1 1. For each of the diagonal blocks 
Corollary |5.7| is applicable and the result follows from Proposition |6.2[ □ 



7. Applications of the general small gain theorem. In Section |3] we have 
presented several examples of functions ^i, 7^ and gain operators F^, F^. Here we will 
show how our main results apply to these examples. Before we proceed, let us consider 



the special case of homogeneous F^ (of degree 1) 



Here F^ is homogeneous of 



degree one if for any s g M" and any r > we have F^(rs) — rF^(s). 

Proposition 7.1 (Explicit paths and Lyapunov functions for homogeneous gain 
operators). LetT, in (1.2| be a strongly connected network of subsystems (l.ll andV^j^, 

be the corresponding gain operators. Let T ^ be homogeneous and let F^ satisfy one 
of the conditions (6.3), (6.4 1, or (5.13). //F^ satisfies the strong small gain condition 



(sSGC) ('(SGCl in case of (6.4)j then the interconnection S is ISS, moreover there 
exists a (nonlinear) eigenvector < s G M" ofTf^ such that F;i(s) = As with A < 1 
and an ISS Lyapunov function for the network is given by 

Vix)^msix{V,{x,)/s,}. (7.1) 



6.4 or 5.8 can be apphed and 



Proof. First note that one of the Corollaries 6.3 
the ISS property follows immediately. By the assumptions of the proposition we 
have an irreducible monotone homogeneous operator F^ on the positive orthant M" . 
By the generalized Perron- Frobenius Theorem |13j there exists a positive eigenvector 
s G M" . Its eigenvalue A is less than one, otherwise we have a contradiction to the 
small gain condition. The ray defined by this vector s is a corresponding fi-path and 
by Theorem 5.3 we obtain (7.1 1. □ 

One type of homogeneous operators arises from linear operators through multi- 
plicative coordinate transforms. In this case we can further specialize the assumptions 
of the previous result. 

Lemma 7.2. Let a G /Coo satisf'^a{ab) — a{a)a{b) for all a,b > 0. Let D = 
diag(a), G G M"^", and F^ be given by 

T,{.s)^D-\GD{s)). 



^In other words, a{r) = r'^ for some c > 0. 
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Then is homogeneous. Moreover, ^ id if and only if the spectral radius of G is 
less than one. 

Proof. If the spectral radius of G is less than one, then there exists a positive 
vector s satisfying Gs < s: Just add a small S > to every entry of G, so that the 
spectral radius p{G) of G is still less than one, due to continuity of the spectrum. Then 
there exists a Perron vector s such that Gs < Gs = p{G)s < s. Define s = D~^{s) > 
and observe that a~^{ab) = a~^{a)a~^{b). Then we have 

r^(rs) = D-\GD{rs)) = D-\a{r)GD{s)) = rD-\GS) (7.2) 

< rD^^{s) — rs , 

for all r > 0. So an fi-path for is given by a{r) = rs for r > 0. Existence of an 
ri-path implies the small gain condition: The origin in is globally attractive with 
respect to the system 5*^+^ = T^{s''), as can be seen by a monotonicity argument. By 
[61 Theorem 23] or [25l Prop. 4.1] we have ^ id. 

Assuming that the spectral radius of G is greater or equal to one there exists s G 
Wl, Sy^O, such that GS > S. Defining s = D-^{S) we have r^(s) = D-^{GD{s)) = 
D~^{Gs) > D~^{s) = s. Hence ^ id if and only if the spectral radius of G is less 
than one. 



Homogeneity of F^ is obtained as in (7.2 1. □ 



7.1. Application to linear interconnected systems. Consider the intercon- 



nection (3.2 1 of linear systems from Section 3.1 



Proposition 7.3. Let each in (3.2) be ISS with a quadratic ISS Lyapunov 



function Vi, so that the corresponding operator F^ can be taken to be as in (3.5 I. // 
the spectral radius r(G) of the associated matrix 

is less than 1, then the interconnection 

S: x^{A + l^)x + Bu 
is ISS and its (nonsmooth) ISS Lyapunov function can be taken as 

V{x) — max — xj PiXi 

i Si 

for some positive vector s G M" . 

Proof. We have F^ = D^^{GD{-)), where D = diag(a) for a{r) = y/r. Now a 
satisfies the assumptions of Lemma |7.2| which yields that F^ satisfies the small gain 
condition F^ ^ id if and only if r{G) < 1. If G or equivalently F^ is irreducible then 



there exists by Proposition 7.1 an s > such that Fp(s) < s. By (3.5) we see, that 
there exists an r* S (0,cxd) such that Fp(s,r*) < s. Then defining cr(r) = rs,(p{r) = 
y/rr* we obtain for all r > that 

Fp(cr(r), (^(r)) = rF^(s, r*) < rs = a(r) . 

Thus the conditions of Theorem |5.3| are satisfied and an ISS Lyapunov function can 
be taken as Vix) = max^ j^xfPiX^. 

If G is reducible the previous construction has to be performed for every irre- 
ducible blocks and then the scaling techniques of Section |6] need to be applied. □ 
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7.2. Application to neural networks. Consider the neural network (3.6 1 dis- 
cussed in Section |3.2[ This is a system of coupled nonlinear equations, and we have 
seen that each subsystem is ISS. Note that so far we have not imposed any restrictions 
on the coefhcients ty . Moreover the assumptions imposed on a^, 6^, Si are essentially 
milder then in [35 . However to obtain the ISS property of the network we need to 
require more. The small gain condition can be used for this purpose. It will impose 
restrictions on the coupling terms tijs{xj). From Corollary 5.6 it follows: 



Theorem 7.4. Consider the Cohen- Grossberg neural network (3.6). Let be 
given by and ^i, — l,...,n, as calculated for the interconnection in Section 3.2 
Assume that F^ satisfies the strong small gain condition D oT^ ^ id for s £ M" \ 0. 
Then this network is ISS from {Ji, . . . , Jn)^ to x. 

Remark 7.5. In 135! the authors have proved that there exists a unique equilib- 
rium point for the network and given constant external inputs. They have also proved 
the exponential stability of this equilibrium. We have considered arbitrary external 
inputs to the network and proved the ISS property for the interconnection. 

8. Path construction. This section explains the relation between the small gain 
condition for F^ and its mapping properties. Then we construct a strictly increasing 



ri-path and prove Theorem 5.2 and some extensions. Let us first consider some simple 
particular cases to explain the main ideas, as depicted in Figure [8?l] In the following 
subsections we then proceed to the main path construction results. 




A map T : M" M" is monotone ii x < y implies T{x) < T{y). Clearly 
any matrix F £ (/Coo U {0})"^" together with an aggregation fi G MAFJ^ induces a 
monotone map F^. 

Lemma 8.1. LetT e (/CU{0})"^" and n e MAF"^, such thatV^ satisfies ( [SGC l. 
//s G n{T^), then limfc_o,F^(s) = 0. 

Proof. If s £ Q, then Fp(s) < s and by monotonicity r^(s) < F^(s). By 
induction F^(s) is a monotonically decreasing sequence bounded from below by 0. 
Thus lim/j^oo rj^(s) —■ s* exists and by continuity we have F^(s*) — s* . By the small 
gain condition it follows s* — 0. □ 

Lemma 8.2. Assume that T e {ICU{0})"^'^ has no zero rows and let fi G MAFJJ. 
//O < s G n{Tf,), then 
(i) < F^(s) G ^ 

(ii) for all A G [0, 1] the convex combination s\ := As + (1 — A)F^(s) G fi. 
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Proof, (i) By assumption T^{s) < s and so by the nionotonicity assumption (M2) 
we have rj(r^(s)) < r^(s). Furthermore, as s > and the matrix T has no zeros 
rows, we have that r^(s) > by assumption (Ml). 



(ii) As r^(s) < s it follows for all A G (0,1) that r^(s) < sx < s. Hence by 



monotonicity and using [(i)] 

< r^(r^(s)) < r^(sA) < r^(s) < sa . 

This implies sx G as desired. □ 

Lemma 8.3. Assume that F G (/C U {0})"^" has no zero rows and let ^ G MAP" 



be such that F^ satisfies the small gain condition (SGC). Let s G ri(Fp). Then there 
exists a path in flU {0} connecting the origin and 



s. 



Proof. By Lemma 8.2 the line segment {Ar^(s) + (1 — A)s} C fl. By in duct ion 
all the line segments {AFJJ+^(s) + (1 — A)F^(s)} C for fc > 1. Using Lemma 



we 



see that F^(s) ^ as fc — > cx). This constructs an fi-path with respect to F^ from 
to s. □ 

The following result applies to F whose entries are bounded, i.e., in (/C\/Coo)U{0}. 
Proposition 8.4. Assume that F G (/C U {0})"^" has no zero rows and let ^ G 



MAF^ be such thatTf^ satisfies the small gain condition (SGC). Assume furthermore 
that Fp is bounded, then there exists an fl-path with respect to F^. 

Proof. By assumption the set F^(M") is bounded, so pick s > supF^(M"). Then 
clearly, Fp(s) < s and so s £ CI. By the same argument 77s G for all rj G [l,oo). 
Thus a path in through the point s exists, if we find a path from s to contained 



in n. The remainder of the result is given by Lemma 8.3 □ 

The difficulty now arises if F^ happens to be unbounded, i.e., F contains entries 
of class /Coo- In the unbounded case the simple construction above is not possible. In 
the following we will first consider the case that all nonzero entries of F are of class 
/Coo. Beforehand we introduce a few technical lemmas. 

8.1. Technical lemmas. Throughout this subsection T : M" M" denotes a 
continuous, monotone map, i.e., T satisfies T(v) < T(w) whenever v < w. We start 
with a few observations. 

Lemma 8.5. Let p G /Coo- Then there exists a p £ K-^o such that {id+ p)^^ = 
id — p. 

Proof. Just define p= po[id+p)^^. Then (id— /?)o(id+/9) = (id+p) — /?o(id+yo) = 
id + p — /9 o (id + p)^^ o (id + p) = id + p — p = id, which proves the lemma. □ 
Lemma 8.6. 

(i) Let D = diag(p) for some p G /Coo such that p > id. Then for any k > there 
exist p''i\p^^ G /Coo satisfying p^^^ > id, such that for — diag(pp''), 

i=l,2, 

D = D^^ oDf\ 

Moreover, D2 , k > 0, can be chosen such that for all < s ^ WJ^ we have 

Df\s)<Df+^\s). 

(ii) Let D = dia,g{id+ a) for some a G /Coo. Then there exist ai,a2 G /Coo; such 
that for Di = dia,g(id+ ai), i — 1,2, 
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For maps T : M!f: M" define the decay set 

^{T) {s e M"^ : T{s) < s} , 

where we again omit the reference to T if this is clear from the context. 

Lemma 8.7. Let T : R" K" be monotone and D — diag(p) for some p G 
l^oc, P > id. Then 

(i) r'=+i(^') C T''{^) for all k > 0; 

(a) ^{D oT)r]{s gRI : s > 0} C n{T), ifT satisfies T{v) < T{w) whenever 

V < w; the same is true for D o T replaced by T o D; 
The proofs of the lemmas are simple and thus omitted for reasons of space. Nev- 
ertheless they can be found in [21] p. 10, p. 29]. 

We will need the following connectedness property in the sequel. 
Proposition 8.8. Let T e {K. U {0})"''" and p. e MAF"^ be such that 



satisfies the small gain condition (SGC). Then is nonempty and pathwise connected. 
Moreover, if T ^ satisfies F ^(v) < Tf^(w) whenever v < w, then for any s € i^(r^) 
there exists a strictly increasing fl-path connecting and s. 

Proof. Note that always € hence cannot be empty. Along the lines the 
proof of Lemma [8T3| it follows that each point in "if is pathwise connected to the origin. 
□ 

Another crucial step, which is of topological nature, regards preimages of points 
in the decay set "if. In general it is not guaranteed, that for s S M" with T{s) G 
we also have s G ^P. The set of points in ^' for which preimages of arbitrary order are 
also in is the set 



k=0 

Of course, this set might be empty or bounded. We will use it to construct fi-paths 
for operators satisfying the small gain condition. 

Proposition 8.9 ([25, Prop. 5.4]). Let T : M" ^ M" be monotone and contin- 
uous and satisfy T(s) ^ ,s for all s =/= 0. Assume that T satisfies the property 

\\sk\\^^ =^ \\T{sk)\\ ^oo (8.1) 

as k ^ oo for any sequence {sk}keti C M" . 

Then «'oo(r) C ^'(T), ^'oo(r) D Sr ^ ^ for all r>0, and ^'oo(r) is unbounded. 

A result based on the topological fixed point theorem due to Knaster, Kuratowski, 
and Mazurkiewicz allows to relate and the small gain condition. It is essential for 
the proof of Proposition |8.9| 

Proposition 8.10. Let T : M" M" be monotone and continuous. LfT{s) ^ s 
for all s £ M" then the set f2 H 5*^ is nonempty for all r > 0. 

In particular, s G f2 n S'r for r > implies s > 0. The proof for this result can be 
found in [24, Prop. 1.5.3, p. 26] or in a slightly different form in [B]. 

8.2. Paths for /CooU{0} gain matrices. In this subsection we consider matrices 
F € (/Coo U {0})"^", i.e., all nonzero entries of F are assumed to be unbounded 
functions. 

In this setting we assume and utilize that the graph associated to F is strongly 
connected, i.e., F is irreducible. So that if we consider powers Fjj(x), for each com- 



24 



S.N. DASHKOVSKIY, B.S. RUFFER, F.R. WIRTH 




ponents i and j there exists a. k — k{i,j) such that t i-^ r^j(t • ej)i is an unbounded 
function. 

Theorem 8.11. Let T G (/Coo U {0})"^" be irreducible, fj. G MAF^, and assume 
^ id. Then there exists a strictly increasing path a G /C^ satisfying 

T^{a{r)) < a{r), Vr > 0. 



The main technical difficulty in the proof is to construct the path in the un- 
bounded direction, the other case has already been dealt with in Proposition |8.8[ 

The proof comprises the following steps: First due to [IS) Prop. 5.8] we may 
choose a /Coo function (/3 > id so that for D — dia,g{(p) we have o D ^ id. Then 
we construct a monotone (but not necessarily strictly monotone) sequence {s''}k>o 
in ^'(r^ o D), satisfying s'^ — r^(_D(s'^+^)) ^ s'^^^, so that each component sequence 
is unbounded. At this point a linear interpolation of the sequence points may not 
yield a strictly increasing path. So finally we use the "extra space" provided by D in 
the set ri(r^) D ri(r^ o D) to obtain a strictly increasing sequence {s'^}fc>o in ^^(r^,) 
which we can linearly interpolate to obtain the desired il-path. 

Proof. Since F is irreducible, it has no zero rows and hence F^ satisfies F^(u) < 
Fp(w) whenever v < w. By [25, Prop. 5.8] there exists a </? > id so that for D = 
diag(99) we have o D ^ id. Now we construct a nondecreasing sequence {s^} in 



Let T :— F^ o D . Th en T and by induction also all powers T , I > 1, satisfy (8.11 
By Proposition 8.9 the set "i'ooiT) is unbounded, so we may pick an 7^ s" G 



^oo(2^)- We can actually choose s° > 0, since the sequence {s'^} we are going to 
construct will be unbounded in every component, at which point we may replace s" 
by some s^ > for k large enough. 



Due to irreducibility of F (and Remark 2.6 1 the following property holds: For any 



pair I < i, j < n there exists an / > 1 such that 



r - (r^(re,))i (8.2) 



is an unbounded and increasing function, where Cj is the j-th unit vector. By mono- 
tonicity the same holds when T is considered instead of F^. Now define a sequence 
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{s''}k>o by choosing 

^fc+i ^ T-i(s'=)n«'oo(T) 

for fc > 0. This is possible, since by definition "^coiT) is backward invariant under T. 

This sequence {s*^} satisfies s'^ ^ s*^"*"^ by definition. We claim that it is un- 
bounded, and also unbounded in every component: To this end assume first that it is 
bounded. Then by monotonicity there exists a limit s* = limfe^oo s*^- By continuity 
of T and since s'' — T{s''^^) we have 

_ / k + 1 



s* = lim s" = lim T(s'=+^) = T[ lim 3"+' = T{s*) 

k — >oo k — >oo \k — >oo J 

contradicting T{s) ^ s for all s 7^ 0. Hence the sequence {s''"} must be unbounded. 
Let j be an index such that {sH^gN is unbounded, let i e {1, . . . , n} be arbitrary 



and choose / such that the function in (8.2 1 is unbounded for i,j,l. Choose real 



numbers r/. — > 00 such that r^e, < for all k E N. Then we have 



(^'(rfce,)).<(T'(s^)), = s^^ 

As the term on the left goes to cx3 for fc — ^ cx), so does s^. Hence {s''} is unbounded 
in every component. 



Now by Lemma 8.7 li) the sequence {s'^} is contained in ri(r^), but it may not 
be strictly increasing, as we only know s'^ ^ s'^+^_for all fc > 0. We define a strictly 



increasing sequence {s } as follows: By Lemma 8.6 for any fc > we may factorize 



D ^ D^^ o ^ so that d[''\d^2^^ > id and -Of ^(s) < D}f^"'{s) for all fc > and all 
s > 0. Using this factorization we define 

5^= := D^^\s'') 

(k) 

for all fc > 0. By the definition of Z?2 i this sequence is clearly strictly increasing and 
inherits from {s*^} the unboundedness in all components. 
We claim that {s''} C ^^(rp): This follows from 

5'= > > o D{s'') = o D^^^ o Df\s^) = o Df\s'') > r^(S'=). 
Now we prove that for A e (0, 1) we have (1 — A)s''' + As'^+^ G fi(r^). Clearly 
S'' < (1 - X)S'' + As'^'+i < I'^+i 
and application of the strictly increasing operator yields 

r^((i - xys'^ + As'^+i) < r^(s"+i) 

^s'' <S'' < (1- A)5'= + AS'=+i. 

Hence (1 - A)S'^ + AS'^+i e n{T^). 

Now we may define ct as a parametrization of the linear interpolation of the poi nts 

for 



(k+i) 



8.3 



{s'^}k>o ill the unbounded direction and utilize the construction from Lemma 
the other direction. Clearly this function a is an fi-path as it has component functions 
of class /Coo and is piecewise linear on every compact interval contained in (0, 00). □ 
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It is possible to consider the reducible case in a similar fashion. The argument 
is essentially an induction over the number of irreducible and zero blocks on the 
diagonal of the reducible operator. We cite the following result from [25^, Theorem 
5.10]. However, for the construction of an ISS Lyapunov function in the case of 
reducible T, we take a different route as described in Section [6] thus avoiding the use 
of assumption (M4) . 

Theorem 8.12. Let T e (/Coo U {0})"^" be reducible, n e MAF^J satisfying 
(M4-), D = diag(zrf+a) for some p £ /Coo; o,nd assume F^oZ) ^ id. Then there exists 
a monotone and continuous operator D : M" M" and a strictly increasing path 
a : M+ — > M" whose component functions are all unbounded, such thatTf^oD(a) < a. 

8.3. General F^. In the preceding subsections we have seen that it is possible 
to construct f2-paths for matrices F whose nonzero entries are either all bounded, or 
all unbounded. It remains to consider the case that the nonzero entries of F are partly 
of class /Coo and partly of class JC \ /Coo- We can state the following result. 

Proposition 8.13. Let F e (/C U {0})"^" and let ^ e MAF;:^ satisfy (M4). 



Assume F^ satisfies (sSGCl. Then there exists an ft -path for T fj,. 
Proof. Write 

T = Tu + Tb 

with Tu £ (/Coo U {0})"><", Fb e (/C \ /Coo U {0})"><". Clearly we have (Fy)^ < F^ 
and (Fs)/i < F^ and hence both maps satisfy 

(r.)^ t id, 

where • serves as a placeholder for the subscripts U and B. 
The map (F g)^ is bounded. Hence s* := sup(Fb)p(IR" ) is a finite vector. 



By Theorem 8.12 for (F^);^ there exists a /Coo function p and a /Coo-path ajj so that 



for the diagonal operator D — diag(id + p) we have 

{{Tu)^ o D){<Ju{r)) < au{r), for all r > . 



Similarly, by Proposition 8.4 there exists a /Coo-path as such that (F_B)^((Ts(r)) < 
(JB{r) for all r > 0. In fact, and this is the key to this proof, it is possible to choose 
(Tb in the region where CTB(r) > s* to grow arbitrarily slowly: For any a, (3 G /Coo we 
can find a k G /Coo, such that 

(a o K){r) < f3{r), r > 0, 

e.g., by choosing k G /Coo satisfying K{r) < {a^^ o /3){r). This is always possible. 
Denote D — diag(p), (so that D = id + D) and choose r* , such that D{au{r*)) > s* . 
Then after reparametrization we may assume that 

CTBir) < D{au{r)) and crB(r) > s* 



for all r > r* . Using Lemma 8.3 we let ■ [0,r*] M" be a finite-length path 
satisfying 

T,{aL{r)) <aL{r), VrG(0,r*], 
(Ji is strictly increasing 
crL(O) = and aL{r*) = aeir*) + au{r*). 
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Now define cr by 

cr(r) 



crBir)+auir) if r > r* 
(TL{r) if r < r*. 



It remains to check that a satisfies Tf^{a{r)) < (T(r) for r > r* . Indeed, for r > r* we 
have 

a{r) = auir) + aeir) > {{Tu)^ o D)iau{r)) + s* 

where the last inequahty is due to (M4). This completes the proof. □ 

8.4. Special case: Maximization. The case when the aggregation is the max- 
imum, i.e., /i = max, is indeed a special case, since not only the small gain condition 
can be formulated in simpler manner, but also the path construction can be achieved 
without the need of the diagonal operator D as before. 

A cycle in a matrix T is finite sequence of nonzero entries of T of the form 

A cycle is called subordinated if ii > max{j2, . . . , and it is called a contraction, if 

l^l,^2 °li2.t3 ° • • -"Hk-M < id- 
It is an easy exercise to show that when all subordinated cycles are contractions then 
already all cycles are contractions. 

Theorem 8.14. Let ^ = max and F e (/C U {0})"^". // all subordinated cycles 
ofT are contractions, then there exists an fl-path with respect to F^. 

The proof is composed of the following steps. The first step is to show that 
the cycle condition (all cycles being contractions) is equivalent to F^ ^ id. Note 
that /i — max automatically satisfies (M4), but (M4) is actually not needed for the 
proof. Then the path-construction can essentially be done as before, replacing sums 
by maximization, and one can even avoid the use of Z) = diag(id + p). Cf. also|25j. 



8.5. Proof of Theorem |5.2| , We now come to the easiest part of this section, 
which is to combine all the preceding results to one general theorem for matrices with 
entries of class /C, namely Theorem |5. 2 [ 



Proof of Theorem 5.2 



(i) In the linear case we can identify F^ with a real matrix with nonnegative 
entries. Then there exists a positive vector w > so that F^w < w if the 
spectral radius p{T^) < 1, cf. [2] or gll Lemma 2.0.1, p. 33]. For r > this 





gives 


Tfj_rv < rv, 


i.e.. 


a /Coo-path is given by a(r) = rv 


(ii) 


This 


is Theorem 


8.11 




(iii) 


This 


is Theorem 


8.14 





(iv) This is Proposition 8.4 □ 



9. Remarks for the case of three subsystems. Recall that a construction 
of an il-path a for the case of two subsystem was given in [17| . We have seen that 
in a general case of n £ N subsystems the construction involves more theory and 
topological properties of F^ that follow from the small gain condition. However in case 
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of three subsystems a can be found by rather simple considerations. Here we provide 
this illustrative construction. Let us consider the special case F e (/Cqo U {0})'^^^, 
= s\ + S2 + S3, j = 1,2,3, and for simplicity assume that 7^ e /Coo for all i ^ j, 
so that 



r = 



712 713 
721 723 

731 732 







712(52) + 713(33) 
72i(si) + 723(^3) 
731 (si) + 732(^2) 




Fix si > 0, then it follows that there is exactly one S2 satisfying 

7lV(si - 712(52)) = 723^(S2 - 72i(si)) , 



(9.1) 



(9.2) 



since, for a fixed Si the left side of (9.2 1 is a strictly decreasing function of S2 while 



the right side of (9.2 1 is strictly increasing one. The small gain condition (9.1) in 
particular assures that 7i2^(72'/(?')) > r for any r > 0. Let be the solution of 
Si — 712(52) = and be the solution of S2 — 721(^1) = then 



7l2^(si) = 712^(721^(52*)) > 5 



2 • 



Hence the root of the left side of (9.2 1 is greater than the root of the right side of 



(9.2). This proves that for any si there is always exactly one S2 satisfying (9.2), see 



Figure [971 



~7l3^(5l -7l2(-)) 



'723^(--72l(si)) 



52 



Fig. 9.1. Visualization of l|9.2 



By the continuity and monotonicity of 712, 721, 713, 723 it follows that S2 depends 
continuously on si and is strictly increasing with si. We can define ai{r) = r for 



r > and 172(7') to be the unique S2 solving (9.2) for si = r. 

Denote h{r) = 731(0-1 (r)) + 732(a'2(»')) and g{r) = 7u{cri{r) -712(0-2(0)) = 
723^('''2(^) ~ 721(0-1 (r))), and define M(r) := {S3 : h{r) < S3 < g{r)}. Let us show 
that M(r) for all r > 0. If this is not true then there exists r* > such that 
sj := h{r*) > g{r*) holds. Consider the point s* :— (si,S2,S3) := (r*, o-2(r*), S3). 
Then 3%, > g{r*) = 7iV(«i - 712(53)), sj > g{r*) = 723^(s2 - 721(5^)), and sj = 
h{r*) = 731 (si) + 732(52). In other words, 

'^712(53) + 7l3( 

F(S*) = I 72l(5l)+ 723( 



V73i(sl) + 732 ( 




contradicting (2.1 1. Hence M{r) is not empty for all r > 0. 
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Consider the functions h{r) and g{r). The question is how to choose (J3{r) € 
M(r) such that (T3 G /Coc- Note that h(r) G /Coo- Let ,g*(r) := niin„>,. (;((;,). so 
that g*{r) < g{r) for all r > 0. Since h{r) is unbounded, for all r > the set 
C(r) := argmin„>r is compact and for all points p G C(r) the relation g*{r) > 
g{p) > h{p) > h{r) holds. We have h{r) < g*{r) < g{r) for all r > where g* is a 
(not necessarily strictly) increasing function. Now take o'3(r) := ^{g*{r) + h{r)) and 
observe that 0-3 e and h{r) < cF^{r) < g*{r) for all r > 0. Hence a := (ui, (T2, cs)^ 
satisfies r^(cr(r)) < cr(r) for all r > 0. 

The case where one of 7,^ is not a K^o function but zero can be treated similarly. 

10. Conclusions. In this paper we have provided a method for the construction 
of ISS Lyapunov functions for interconnections of nonlinear ISS systems. The method 
applies for an interconnection of an arbitrary finite number of subsystems intercon- 
nected in an arbitrary way and satisfying a small gain condition. The small gain 
condition is imposed on the nonlinear gain operator that we have introduced here. 
This operator contains the information of the topological structure of the network 
and the interactions between its subsystems. An ISS Lyapunov function for such a 
network is given in terms of ISS Lyapunov functions of subsystems and some auxiliary 
functions. We have shown how this construction is related to the small gain condition 
and mapping properties of the gain operator and its invariant sets. Namely the 
small gain condition guarantees the existence of an unbounded vector function with 
path in an invariant set f2 of the operator F^. This auxiliary function can be used to 
rescale the ISS Lyapunov functions of the individual subsystems and aggregate them 
into an ISS Lyapunov function for the entire network. The construction technique 
for this vector function has been detailed as well as the construction of the compos- 
ite Lyapunov function. The constructed Lyapunov function is only locally Lipschitz 
continuous, so that methods from nonsmooth analysis had to be used. The proposed 
method has been exemplified for linear systems and neural networks. 
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